Apparatus and method for providing memo function

ABSTRACT

An electronic device is provided. The electronic device includes a display, an electronic pen, a slot in which the electronic pen can be inserted in or detached from, a pen sensing module configured to sense an insertion/detachment of the electronic pen, a pen input module configured to receive an input using the electronic pen, and a processor configured to activate the pen input module while the display maintains an OFF-state when the detachment of the electronic pen is sensed within the OFF-state of the display.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation application of prior application Ser.No. 16/272,222 filed on Feb. 11, 2019, which issued as U.S. Pat. No.10,817,084 on Oct. 27, 2020; which is a continuation application ofprior application Ser. No. 15/205,790 filed on Jul. 8, 2016, whichissued as U.S. Pat. No. 10,228,779 on Mar. 12, 2019, and which was basedon and claimed priority under 35 U.S.C. § 119(a) of a Korean patentapplication number 10-2015-0098691 filed on Jul. 10, 2015, in the KoreanIntellectual Property Office, the disclosure of each of which isincorporated by reference herein in its entirety.

TECHNICAL FIELD

The present disclosure relates to a technology for providing a memofunction in an electronic device configured to include an electronic pensuch as a stylus.

BACKGROUND

Electronic devices, such as a smart phone, a tablet computer, etc.,support a memo or note function. For example, a user executes a memoapplication of the electronic device to input a memo. In addition, theuser generates and stores the memo through a user input (e.g., a touchinput or stylus) after setting the electronic device to a state thatenables the user to input the memo like the execution of the noteapplication.

Since a memo function of the related art is provided by executing theapplication installed on the electronic device, the user is required topush a power button or a home button to turn on a display of theelectronic device, unlock the electronic device, and execute the memoapplication so as to generate and store the memo when the display of theelectric device is in an OFF-state. However, unlocking the electronicdevice or executing the memo application to record a simple memo isinconvenient to the user.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect of the presentdisclosure is to provide an apparatus and a method of minimizing thenumber of processes required to record the memo in the electronic deviceand temporarily or permanently changing the recorded memo to have aformat that allows the user to easily verify and manage.

In accordance with an aspect of the present disclosure, an electronicdevice is provided. The electronic device includes a display, anelectronic pen, a slot in which the electronic pen can be inserted in ordetached from, a pen sensing module configured to sense aninsertion/detachment of the electronic pen, a pen input moduleconfigured to receive an input using the electronic pen, and a processorelectrically connected to the display, the pen sensing module, and thepen input module. The processor is configured to activate the pen inputmodule while the display maintains an OFF-state when the detachment ofthe electronic pen is sensed during the OFF-state of the display. Inaddition, the processor is configured to output a memo screen on thedisplay based on a stroke input obtained from the pen input module andto change a screen output on the display in response to a memotermination event occurring by the pen input module.

In accordance with another aspect of the present disclosure, a method ofproviding a memo function of an electronic device is provided. Themethod includes sensing a detachment of an electronic pen from of a slotthe electronic device when a display is in an OFF-state, activating aninput function of the electronic pen, obtaining a stroke input by theelectronic pen, outputting a memo screen on the display based on thestroke input, sensing a memo termination event, and changing a screenoutput on the display in response to the memo termination event.

In accordance with another aspect of the present disclosure, acomputer-readable recording medium including instructions is provided.The instructions, when executed by an electronic device, cause theelectronic device to perform a method of sensing a detachment of anelectronic pen when a display of the electronic device is in anOFF-state, activating an input function of the electronic pen, obtaininga stroke input by the electronic pen, outputting a memo screen on thedisplay based on the stroke input, sensing a memo termination event, andchanging a screen output on the display in response to the memotermination event.

According to various embodiments of the present disclosure, anenvironment, which enables the user to input the memo, may be built byonly detaching the electronic pen from the electronic device.

In addition, since the number of the elements required to be activatedto record the memo is reduced, a power consumption of the electronicdevice may be reduced.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 illustrates a configuration of an electronic device according toan embodiment of the present disclosure;

FIG. 2 illustrates a method of providing a memo function according to anembodiment of the present disclosure;

FIG. 3 illustrates a user interface for a memo function according to anembodiment of the present disclosure;

FIG. 4 illustrates a method of outputting a pre-defined screen on adisplay after the memo function is terminated according to an embodimentof the present disclosure;

FIG. 5 illustrates a memo screen to which a pre-defined memo set isapplied according to an embodiment of the present disclosure;

FIG. 6 illustrates a screen displaying a memo message and a lock screenaccording to an embodiment of the present disclosure;

FIG. 7 illustrates a memo screen output corresponding to a memotermination event according to an embodiment of the present disclosure;

FIG. 8 illustrates processes of generating and storing a user's recordaccording to an embodiment of the present disclosure;

FIG. 9 illustrates a conversion process of a display screen according toan embodiment of the present disclosure;

FIG. 10 illustrates a screen effect when an electronic pen is detachedaccording to an embodiment of the present disclosure;

FIG. 11 illustrates a screen effect when an electronic pen is insertedaccording to an embodiment of the present disclosure;

FIG. 12 illustrates a screen effect caused by the attachment/detachmentof the electronic pen according to an embodiment of the presentdisclosure;

FIG. 13 illustrates an electronic device in a network environmentaccording to various embodiments of the present disclosure;

FIG. 14 illustrates a block diagram of an electronic device according tovarious embodiments of the present disclosure; and

FIG. 15 illustrates a block diagram of a program module according tovarious embodiments of the present disclosure.

Throughout the drawings, it should be noted that like reference numbersare used to depict the same or similar elements, features, andstructures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

In the following disclosure, the expressions “have”, “may have”,“include” and “comprise”, or “may include” and “may comprise” usedherein indicate existence of corresponding features (e.g., elements suchas numeric values, functions, operations, or components) but do notexclude presence of additional features.

In the disclosure disclosed herein, the expressions “A or B”, “at leastone of A or/and B”, or “one or more of A or/and B”, and the like usedherein may include any and all combinations of one or more of theassociated listed items. For example, the term “A or B”, “at least oneof A and B”, or “at least one of A or B” may refer to all of the case(1) where at least one A is included, the case (2) where at least one Bis included, or the case (3) where both of at least one A and at leastone B are included.

The terms, such as “first”, “second”, and the like used herein may referto various elements of various embodiments of the present disclosure,but do not limit the elements. For example, such terms do not limit theorder and/or priority of the elements. Furthermore, such terms may beused to distinguish one element from another element. For example, “afirst user device” and “a second user device” indicate different userdevices. For example, without departing the scope of the presentdisclosure, a first element may be referred to as a second element, andsimilarly, a second element may be referred to as a first element.

It will be understood that when an element (e.g., a first element) isreferred to as being “(operatively or communicatively) coupled with/to”or “connected to” another element (e.g., a second element), it can bedirectly coupled with/to or connected to the other element or anintervening element (e.g., a third element) may be present. In contrast,when an element (e.g., a first element) is referred to as being“directly coupled with/to” or “directly connected to” another element(e.g., a second element), it should be understood that there is nointervening element (e.g., a third element).

According to the situation, the expression “configured to” used hereinmay be used as, for example, the expression “suitable for”, “having thecapacity to”, “designed to”, “adapted to”, “made to”, or “capable of”.The term “configured to” must not mean only “specifically designed to”in hardware. Instead, the expression “a device configured to” may meanthat the device is “capable of” operating together with another deviceor other components. For example, a “processor configured to perform A,B, and C” may mean a dedicated processor (e.g., an embedded processor)for performing a corresponding operation or a generic-purpose processor(e.g., a central processing unit (CPU) or an application processor (AP))which may perform corresponding operations by executing one or moresoftware programs which are stored in a memory device.

Terms used in this specification are used to describe specifiedembodiments of the present disclosure and are not intended to limit thescope of the present disclosure. The terms of a singular form mayinclude plural forms unless otherwise specified. Unless otherwisedefined herein, all the terms used herein, which include technical orscientific terms, may have the same meaning that is generally understoodby a person skilled in the art. It will be further understood thatterms, which are defined in a dictionary and commonly used, should alsobe interpreted as is customary in the relevant related art and not in anidealized or overly formal detect unless expressly so defined herein invarious embodiments of the present disclosure. In some cases, even ifterms are terms, which are defined in the specification, they may not beinterpreted to exclude various embodiments of the present disclosure.

Hereinafter, an electronic device will be described with reference toaccompanying drawings according to various embodiments. In thedisclosure disclosed herein, a term “user” used herein may refer to aperson who uses an electronic device or may refer to a device (e.g., anartificial electronic device) that uses the electronic device.

FIG. 1 illustrates a configuration of an electronic device according toan embodiment of the present disclosure.

Referring to FIG. 1, an electronic device 100 may include an electronicpen 110, a processor 120, a memory 130, a pen sensing module 140, a peninput module 150, and a display 160. Components shown in FIG. 1 maycorrespond to hardware devices required to implement embodimentsdisclosed in the present disclosure, and hardware/software components,which are apparent to those skilled in the art, may be additionallyincluded in the electronic device 100. For example, a battery supplyinga power to each component of the electronic device 100, a touch screenpanel (TSP) sensing a touch input by a user, a communication modulecommunicating with an external network, etc. may be included in theelectronic device. In the following description of the presentdisclosure, various embodiments will be described based on the hardwaredevices shown in FIG. 1, but it may not be interpreted to exclude otherhardware devices that may replace the hardware devices shown in FIG. 1or may be added to the electronic device 100.

The electronic pen 110 may include all kinds of input members, such as astylus, a touch pen, a capacitive type electronic pen, a resistive typeelectronic pen, etc., that may be mounted inside the electronic device100 and provide a user input through the pen input module 150. Theelectronic device 100 configured to include the electronic pen 110 mayinclude a spaced defined therein to accommodate the electronic pen 110.For example, the electronic device 100 may include a slot or a holewhere the electronic pen 110 may be inserted in or may be detached from.

The processor 120 may communicate with the pen sensing module 140, thepen input module 150, and the display 160, which are electricallyconnected to the processor 120, through an inner bus. In addition, theprocessor 120 may receive a control message or a data message from thepen sensing module 140 and the pen input module 150 to control thedisplay 160 based on the control message and the data message, and theprocessor 120 may perform operations associated with various embodimentsdisclosed in the present disclosure.

In a case that the electronic device 100 is a mobile device, theprocessor 120 may correspond to an AP. The processor 120 may have anappropriate shape or name in accordance with a kind of the electronicdevice 100. For example, the processor 120 may be implemented with asystem on chip (SoC) configured by integrating a CPU, a graphicprocessing unit (GPU), or several processing cores.

In an embodiment, the processor 120 may be one of a plurality ofprocessors included in the electronic device 100. For example, in a casethat the electronic device 100 enters into a sleep state, the processorsincluded in the electronic device 100 may be in the sleep state. In thiscase, when the electronic pen 110 is detached from the electronic device100, a main processor maintains the sleep state, and only the processor120 may be transited to an active state from the sleep state. Forexample, the main processor and the processor 120 may correspond to theAP and a communication processor (CP), respectively. As another example,the main processor may correspond to the CPU, and the processor 120 maycorrespond to the GPU. In the case that the processor 120 corresponds toone of the processors, the processor 120 may be assigned to performoperations associated with an input of an electronic pen and displayfrom other processors.

In addition, the processor 120 may be implemented by a plurality ofprocessors. For example, a first processor may be in charge of a messagetransmission between the processor 120 and the memory 130, the pensensing module 140, and the pen input module 150, and a second processormay be in charge of controlling the display 160. Here, the processor 120may be understood to include the first processor and the secondprocessor.

The memory 130 may store a memo input by the pen input module 150 or amemo screen. For example, the memory 130 may store the input of theelectronic pen 110, which is generated by the pen input module 150, inthe unit of stroke or store the memo screen generated by the pen input110. Furthermore, the memory 130 may separately store strokes includedin the memo screen and background information on the memo screen. In thepresent disclosure, the term “memo” used herein may mean contentgenerated by the electronic pen 110, but should not be limited to eithera text or an image.

The memory 130 may store a memo application. In an embodiment of thepresent disclosure, a user's record (memo) may be output using the memoapplication.

The pen sensing module 140 may sense that the electronic pen 110 isdetached from or inserted into the inside of the electronic device 100.The pen sensing module 140 may determine the detachment/attachment (orinsertion) and a degree of the detachment/attachment of the electronicpen 110 using an electric or magnetic method. For example, the pensensing module 140 may determine a length of a portion of the electronicpen 110, which is detached from the electronic device 100, or rateinformation on the length (e.g., about 35 mm or about 30%). When thedetachment/attachment of the electronic pen 110 is sensed, the pensensing module 140 may provide information on the detachment/attachmentand the degree of the detachment/attachment to the processor 120.

The pen input module 150 may recognize the input through the electronicpen 110. Information on the recognized input (e.g., stroke) may beprovided to the processor 120.

The pen input module 150 may be implemented in different configurationsdepending on an input method occurring by the electronic pen 110. Forexample, in a case that the electronic pen 110 provides a touch input,the pen input module 150 may be a module that is capable of recognizingthe touch input or may be a TSP. In a case that the electronic pen 110provides an optical input, the pen input module 150 may be a moduleconfigured to include an optical recognition sensor.

The display 160 may include, for example, a liquid crystal display(LCD), a light-emitting diode (LED) display, an organic LED (OLED)display, a microelectromechanical systems (MEMS) display, or anelectronic paper display. According to an embodiment, the display 160 isimplemented by an active-matrix organic light-emitting diode (AMOLED),and the display 160 may turn off corresponding elements to display ablack background.

In addition, the display 160 may form a plurality of layers with the peninput module 150. In other words, the display 160 may include a layerconfigured to include a glass layer to protect the display 160 fromexternal impacts, an AMOLED layer to display colors, and the pen inputmodule 150 to recognize the pen input. The display 160 should not belimited to the above-mentioned configuration and may be implemented invarious configurations depending on the kind of the electronic device100.

Hereinafter, a method of providing a memo function using the electronicdevice 100 will be described in detail with reference to FIGS. 2 to 4.

FIG. 2 illustrates a method of providing a memo function according to anembodiment of the present disclosure.

Referring to FIG. 2, a process of providing a memo function may startwhen the display 160 of the electronic device 100 is in an OFF-state.For example, the processes shown in FIG. 2 may start when the user turnsoff the display 160 by pushing a power button or a sleep button of theelectronic device 100 or when the display 160 of the electronic device100 becomes turned-off after a predetermined time lapses without theuser input.

In operation 210, when the electronic pen 110 begins to be detached fromthe electronic device 100, the pen sensing module 140 may sense thedetachment of the electronic pen 110. The pen sensing module 140 mayobtain information indicating that the detachment of the electronic pen110 begins and information on the detached degree (e.g., the lengthrate) of the electronic pen 110.

When the electronic pen 110 is detached from the electronic device 100,the electronic device 100 may activate an input function of theelectronic pen 110 to recognize the user input through the electronicpen 110 in operation 220. For example, the processor 120 may activatethe pen input module 150. In this case, the display 160 may maintain theOFF-state. However, according to another embodiment, when the pen inputmodule 150 is activated, a screen (e.g., a screen 1110 shown in FIG. 11)may be displayed on the display 160 to indicate that the memo functionis available. However, although a screen effect, such as the screenshown in FIG. 11, is provided, the screen background may maintain theblack color. Particularly, in case of the AMOLED-based display device,pixels (or elements corresponding to the pixels) other than charactersor graphics indicating the availability of the memo may be in theOFF-state.

In operation 230, the electronic device 100 may receive the user inputusing the electronic pen 110. The user input may include a stroke inputcorresponding to the memo and a control input (e.g., delete, undo,re-do, save, initialize, etc.) editing the memo. The stroke input mayform a content of the memo. The pen input module 150 may apply theobtained stroke to the processor 120, and the processor 120 may displaythe memo screen on the display 160 based on the stroke input providedfrom the pen input module 150 in operation 240. For example, the memoscreen obtained by drawing Picasso's work as shown in FIG. 3 may bedisplayed on the display 160.

In operation 250, the electronic device 100 may sense that a memotermination event occurs. The memo termination event may be previouslydefined in various ways. For example, sensing the attachment of theelectronic pen 110 to a mounting space of the electronic device 100 maycorrespond to the memo termination event. In addition, in the case thatthe electronic pen 110 provides the control input, the memo terminationevent may occur. For example, the display 160 may display a control menucorresponding to each control input through a certain area, and when apre-defined control menu (e.g., store) is selected by the electronic pen110, the processor 120 may determine that the memo termination eventoccurs. This operation will be described with reference to FIG. 3.

FIG. 3 illustrates a user interface for a memo function according to anembodiment of the present disclosure.

Referring to FIG. 3, the display 160 may be divided into two or moreareas. For the convenience of explanation, the display 160 shown in FIG.3 may be include an area 310 (AREA A) configured to include at least onecontrol menu and an area 320 (AREA B) configured to receive the strokeinput. For example, when the electronic pen 110 is detached from theelectronic device 100, the processor 120 may set the display 160 toallow the area 310 and the area 320 to be distinguished from each other.For instance, the electronic device 100 may recognize the stroke inputprovided to the area 320 to output the graphic, but the stroke inputprovided to the area 310 may not be output. In addition, the area 310and the area 320 may be not only functionally distinguished from eachother but also visually distinguished from each other. For example, athin line indicating a border between the area 310 and the area 320 maybe shown.

Various control menus may be displayed on the area 310. For example, adelete menu deleting a certain area of the memo screen (changing thedisplayed graphic to the black background), an undo menu canceling theinput in the unit of stroke, a re-do menu returning to a state beforethe undo menu is executed, a new memo or clear menu initializing acurrent memo screen, and a save menu saving the current memo screen maybe appropriately arranged in the area 310. In addition, additionalinformation, e.g., a name of memo, a writing time of memo, etc., may bedisplayed on the area 310. According to an embodiment, the area 310 mayrecognize not only the input through the electronic pen 110 but also thetouch input by a user's hand. For example, the electronic device 100 mayactivate the TSP corresponding to the area 310 or the TSP correspondingto the whole display and ignore a touch input occurring in an area otherthan the area 310.

Referring to FIG. 2 again, when the electronic pen 110 is attached tothe electronic device 100 again or the memo termination event, e.g.,selection of the save menu in the area 310, occurs, the electronicdevice 100 may change the screen displayed on the display 160 inoperation 260. For example, responsive to the memo termination event,the electronic device 100 may display a screen, which is different fromthe screen displayed before the occurrence of the memo terminationevent, on the display 160. The screen displayed on the display 160 afterthe memo termination event may be determined depending on the memotermination event, but additionally, the screen displayed on the display160 after the memo termination event may be determined in accordancewith the setting or status (e.g., whether a lock function of theelectronic device 100 is set) of the electronic device 100. Hereinafter,a screen transition of the display 160 according to situations will bedescribed with reference to FIG. 4.

FIG. 4 illustrates a method of outputting a pre-defined screen on adisplay after the memo function is terminated according to an embodimentof the present disclosure.

Referring to FIG. 4, the method may be performed after the appropriateoperation among the operations shown in FIG. 2. For instance, anoperation “A” shown in FIG. 4 may correspond to the operation 250 showin FIG. 2.

When the memo termination event occurs, the processor 120 may determinewhether the memo termination event corresponds to the attachment of theelectronic pen 110 in operation 410. For example, when the electronicpen 110 is attached to the electronic device 100 again after the memo iswritten, the pen sensing module 140 may provide information indicatingthe attachment of the electronic pen 140 to the processor 120, and theprocessor 120 may determine that the memo termination event occurs onthe basis of the information from the pen sensing module 140.

In the case that it is determined that the memo function is terminateddue to the attachment of the pen, the electronic device 100 maydetermine whether the electronic device 100 is locked in operation 420.In the case that the lock is set to the electronic device 100, theelectronic device 100 may display a lock screen on the display 160 inoperation 430. The lock screen may be output with the message associatedwith the memo screen generated in the operation 240. For example, theprocessor 120 may output a pre-defined lock screen (e.g., a screenrequiring a password, a pattern input, a fingerprint recognition, etc.,)to the display 160 together with a message indicating that the memoexists or the memo is stored.

If in the case that the lock is not set, the electronic device 100 mayoutput a home screen in operation 440. In this case, the electronicdevice 100 may display a message associated with the memo screen on thehome screen in a popup message or a notification bar form.

In the case that it is determined that the memo function is terminatedin a manner other than the attachment of the pen, e.g., in the case thatthe save menu is selected in the area 310, the electronic device 100 mayapply pre-defined settings to the input memo (e.g., the memo screen inoperation 240) in operation 450. The term “pre-defined settings” usedherein may correspond to settings of the memo screen of the memoapplication installed in the electronic device 100. For example, thesettings may include information on a background of the memo, a kind ofpen (a brush, a ball pen, a fountain pen, a magic pen, etc.), athickness of pen-tip, a color of pen, etc. As an example, when the savemenu is selected, information on the background screen, information onthe pen to be applied to the stroke, and information on the color of thepen may be applied to the memo screen (the current memo screen may berepresented by only the black background and the color (e.g., a white orgray color) of the graphic corresponding to the stroke). In other words,the memo screen displayed on the display 160 may be displayed like thememo written while the memo application is executed.

The process described with reference to FIG. 4 may be varied indifferent ways. For example, when the electronic pen 110 is attached tothe electronic device 100 again after the user writes the memo, theelectronic device 100 may switch the display to the OFF-state likebefore the memo is written (before the electronic pen 110 is detached).In this case, the information on the memo screen may be verified whenthe user executes the memo application or another application (e.g., aphoto application, a note application, a notification bar, etc.) in theelectronic device 100 after being stored. Hereinafter, examples in whichthe settings are applied to the generated memo screen will be describedwith reference to FIGS. 5 to 7, and a whole process will be describedwith reference to FIG. 8.

FIG. 5 illustrates a memo screen to which a pre-defined memo set isapplied according to an embodiment of the present disclosure.

Referring to FIG. 5, a screen 510 may correspond to the memo screengenerated in operation 240. The memo screen 510 may include the strokeexpressed by white, gray, or arbitrary solid-color on a black backgroundbased on the input stroke. When the pre-defined settings are applied tothe memo screen 510, a screen that is visually improved like the memoscreen 520 or obtained when the memo is written in the memo applicationmay be obtained. Such content conversion (content transfer) or fileconversion (file transfer) may be carried out in several stages ofembodiments disclosed in the present disclosure. For example, thecontent conversion may be carried out in the case that the memotermination event occurs, and the converted memo screen may be stored inthe memory 130. As another way, when the memo termination event occurs,information on the memo screen 510 may be stored, but when the memoscreen 510 is loaded later in the memo application, setting informationon the current memo application may be applied to the memo screen 510 orsetting information on the memo application at the time at which thememo screen 510 is generated may be applied to the memo screen 510 todisplay a memo screen 520 on the display 160.

FIG. 6 illustrates a screen displaying a memo message and a lock screenaccording to an embodiment of the present disclosure. FIG. 6 shows anexample corresponding to the lock screen output as the result ofexecuting operation 430 of FIG. 4.

Referring to FIG. 6, a screen 610 may correspond to the memo screendescribed in FIG. 3. In other words, the screen 610 may correspond to amemo screen generated based on a memo input with respect to a certainarea divided from the entire area of the display 160. However, thescreen 610 may correspond to a memo screen generated with respect to theentire area of the display 160.

When the electronic pen 110 is inserted into the electronic device 100(or the attachment of the electronic pen 110 is completed), theelectronic device 100 may display a lock screen 620. The lock screen 620may include a message 630 indicating that a memo exists. The message 630may include the name of the memo, the writing time of the memo, and thelike, which are automatically generated by the electronic device 100. Inaddition, according to an embodiment, the above-mentioned fileconversion (or the content conversion) may be performed at the time atwhich the attachment of the electronic pen 110 is completed.

FIG. 7 illustrates a memo screen output corresponding to a memotermination event according to an embodiment of the present disclosure.FIG. 7 shows an example corresponding to a screen output as the resultof executing operation 450 of FIG. 4.

Referring to FIG. 7, a screen 710 may correspond to an example showingthat the memo is input to the divided area described in FIG. 3.

When the save button located at the area in which the control menu isdisplayed is selected by the electronic pen 110, the electronic device100 may apply pre-defined settings to the memo screen 710 to convert thememo screen 710 displayed on the display 160 to a memo screen 720.According to an embodiment, the memo screen may be stored by the touchinput of the user instead of the electronic pen 110 as described above.

According to an embodiment, the memo screen 710 may be temporarilyconverted to the memo screen 720 by selecting the save button or apreview menu in the control menu. For example, when the save button ispushed without attaching the electronic pen 110 to the electronic device100, the electronic device 100 may determine that the user continuouslyperforms the writing of the memo. Accordingly, the electronic device 100may temporarily display a screen that is to be displayed in the memoapplication, and thus the user may know in advance how the memo createdby the user will be shown later. In addition, in the case that thepreview menu is selected, the electronic device 100 may output the memoscreen 720 only during a time period in which the preview menu isselected by the electronic pen 110 or the user's finger.

FIG. 8 illustrates processes of generating and storing a user's recordaccording to an embodiment of the present disclosure. FIG. 8 shows theprocesses in which the user starts the memo function, writes the memo,and saves the memo using the electronic pen 110. In addition, the term“operation” used in FIGS. 8 and 9 may be understood as a kind of“state”.

Referring to FIG. 8, in operation 810, the electronic pen 110 may startto be detached from the electronic device 100. The display 160 of theelectronic device 100 may maintain the OFF-state until the electronicpen 110 is completely detached from the electronic device 100. Accordingto an embodiment, although the electronic pen 110 is completely detachedfrom the electronic device 100, the display 160 may continuouslymaintain the OFF-state.

In operation 820, when the electronic pen 110 is completely detachedfrom the electronic device 100, the memo function may be activated. Forexample, the pen input module 150 may be activated to sense the input ofthe electronic pen 110. In addition, an indication, a message, agraphic, or an icon may be displayed to indicate that the memo functionis activated. An area except for the display area may continuouslymaintain the black background. The term “black background” used hereinmeans that corresponding elements are in the OFF-state in the case thatthe display 160 is the AMOLED-based device.

In operation 830, the electronic device 100 may receive the stroke inputfrom the electronic pen 110. In the case that the display 160 is dividedinto two or more areas in operation 820, the stroke may be input to thepre-defined area. During operation 830, the electronic device 100 maydisplay the memo screen based on the input obtained from the electronicpen 110.

Operations 840 and 850 may correspond to the storing of the memo inputin operation 830. Operation 840 may show the memo termination eventoccurring by the attachment of the electronic pen 110 to the electronicdevice 100, and operation 850 may show the memo termination eventoccurring by the selection of the control menu. Since the memotermination event is described in the above-mentioned embodiments,details thereof will be omitted.

In operation 860, the file conversion may be performed on the memoscreen generated in operation 840 or operation 850. For example, thepre-defined setting information may be applied to the stroke informationand the background information to convert the memo screen, and theconverted screen may be stored. However, as described above, operation860 may be performed later when the memo application is executed.

In operation 870, the electronic device 100 may output the messageassociated with the memo together with the lock screen. Furthermore, inoperation 880, the electronic device 100 may output the memo screen towhich the pre-defined settings are applied. Operation 870 may beperformed after operation 840, but operation 880 may be performed afteroperation 840 according to embodiments. Similarly, operation 880 may beperformed after operation 850, but operation 870 may be performed afteroperation 850 according to an embodiment.

FIG. 9 illustrates a conversion process of a display screen according toan embodiment of the present disclosure. In FIG. 9, descriptionsduplicated with, similar to, or corresponding to those described withreference to FIGS. 1 to 8 will be omitted.

Referring to FIG. 9, in operation 910, when the electronic pen 110 isdetached, the memo function may be activated (e.g., the pen input module150 is activated) as shown in operation 920. While in this state, whenthe electronic pen 110 is inserted again without any memo, theconversion process may return to operation 910.

In operation 920, when the memo is input through the electronic pen 110,the memo screen may be displayed on the display 160 as shown inoperation 930.

In operation 930, when the display enters the OFF-state itself after apredetermined time lapses or the power button (key) is pushed by theuser, the process may proceed to operation 940. When entering operation940, the memo screen may be stored. In the case that the home button isselected or the display 160 is switched to the ON-state by thepre-defined input, the process may proceed to operation 960 or operation970 in accordance with whether the electronic device 100 is locked ornot as determined in operation 950.

In the case that the pre-defined input, e.g., the home button or backkey, occurs, or the save/cancel button is selected by the electronic pen110 in operation 920, the process may proceed to operation 960 oroperation 970 in accordance with whether the electronic device 100 islocked or not (if the electronic pen 110 is inserted, the process mayproceed to operation 910) as determined in operation 950. In the casethat the pre-defined input, e.g., the home button or back key, occurs,the save or cancel button is selected by the electronic pen 110, or theelectronic pen 110 is inserted, the process may proceed to operation 960or operation 970 in accordance with whether the electronic device 100 islocked or not.

In the case that the electronic device 100 is not locked, the electronicdevice 100 may output the home screen with the message associated withthe memo in operation 960. In the case that the electronic device 100 islocked, the electronic device 100 may output the home screen with themessage associated with the memo in operation 970. If the memo is notinput in operation 920, the message associated with the memo may beomitted. In addition, in the case that the memo application is executedafter the electronic device 100 is unlocked in operation 960 oroperation 970, the memo screen generated in operation 930 may bedisplayed on the display 160 in operation 980. In this case, the memoscreen to which the settings of the memo application are applied may bedisplayed on the display 160.

FIG. 10 illustrates a screen effect when an electronic pen is detachedaccording to an embodiment of the present disclosure.

Referring to FIG. 10, when the electronic pen 110 is detached from orinserted into the electronic device 100, an appropriate visual effectmay be output through the display 160. In embodiments described withreference to FIGS. 10 to 12, at least a portion of the display may notbe in the OFF-state during the attachment of the electronic pen 110.

The display 160 may be in the OFF-state (black color) as a screen 1010right before the electronic pen 110 is detached. When the electronic pen110 is detached, the visual effect, which is changed depending on thedegree of the detachment of the electronic pen 110, may be outputthrough a position corresponding to the electronic pen 110. For example,a screen 1020 may be the visual effect corresponding to the state inwhich the degree of the detachment of the electronic pen 110 is about20%, a screen 1030 may be the visual effect corresponding to the statein which the degree of the detachment of the electronic pen 110 is about40%, a screen 1040 may be the visual effect corresponding to the statein which the degree of the detachment of the electronic pen 110 is about60%, a screen 1050 may be the visual effect corresponding to the statein which the degree of the detachment of the electronic pen 110 is about80%, and a screen 1060 may be the visual effect corresponding to thestate in which the electronic pen 110 is completely detached. Theserates may be merely illustrative and embodiments and adjusted for anatural effect.

According to various embodiments, the visual effect may be continuouslyexpressed. For example, the pen sensing module 140 may continuouslydetermine the degree of the detachment of the electronic pen 110 andprovide information on the detachment degree of the electronic pen 110to the processor 120. The processor 120 may control the display 160 toallow various visual effects, such as a fluid effect, to be continuouslyoutput in accordance with the detachment degree of the electronic pen110. In addition, the visual effect may be displayed such that the fluidis expanded or bounded in a direction opposite to the direction in whichthe electronic pen 110 is detached from the electronic device 100.However, according to an embodiment, the visual effect may be providedin the direction in which the electronic pen 110 is detached from theelectronic device 100 or as an arbitrary pattern.

FIG. 11 illustrates a screen effect when an electronic pen is insertedaccording to an embodiment of the present disclosure. The process shownin FIG. 11 may be understood as an opposite process to the process shownin FIG. 10.

Referring to FIG. 11, when the electronic pen 110 starts to be insertedin a state in which a screen 1110 is output, a visual effectcorresponding to the attachment of the electronic pen 110 may be output(screen 1120) through the area corresponding to the position at whichthe electronic pen 110 is inserted. When the electric pen 110 iscompletely inserted, a screen 1130 may be output in which the visualeffect may disappear and the display may be switched to the OFF-state.However, as the above-described various embodiments, different screensmay be output in accordance with the lock state of the electronicdevice.

FIG. 12 illustrates a screen effect caused by the attachment/detachmentof the electronic pen according to an embodiment of the presentdisclosure.

Referring to FIG. 12, the electronic pen 110 may be attached to ordetached from a right lower end portion of the electronic device 100.The position to which the electronic pen 110 is attached may bedifferent depending on the kind and shape of the electronic pen 100, anda smart phone (e.g., Galaxy Note series) equipped with an electronic penwill be described with reference to FIG. 12 as a representative example.

As shown in a screen 1210, when the electronic pen 110 starts to bedetached, a detachment effect may appear at a position corresponding tothe electronic pen 110. In this state, the more the electronic pen 110is detached, the larger the detachment effect is displayed as shown in ascreen 1220. Then, when the electronic pen 110 is further detached, thevisual effect may be varied as shown in a screen 1230, and if theelectronic pen 110 is inserted again, the visual effect as shown in thescreen 1210 may be output. That is, the visual effect may be differentdepending on the degree of the detachment or attachment of theelectronic pen 110 before the electronic pen 110 is completely detached.For example, the visual effect may appear in the direction opposite tothe direction to which the electronic pen 110 moves. However, in thecase that the electronic pen 110 is inserted again after the electronicpen 110 is completely detached as shown in a screen 1240, the visualeffect may be output to the direction to which the electronic pen 110moves as shown in FIG. 11. In other words, different visual effects maybe displayed in an initial state of the visual effect in accordance withwhether the electronic pen 110 is completely inserted or whether theelectronic pen 110 is completely detached.

Hereinafter, various configurations that are included or may be includedin the electronic device 100 will be described with reference to FIGS.13 to 15.

FIG. 13 illustrates an electronic device in a network environmentaccording to various embodiments of the present disclosure.

Referring to FIG. 13, tan electronic device 1301 is provided in anetwork environment 1300 according to various embodiments. Theelectronic device 1301 may include a bus 1310, a processor 1320, amemory 1330, an input/output (I/O) interface 1350, a display 1360, and acommunication interface 1370. According to an embodiment, among theelements of the electronic device 1301, at least one of theabove-mentioned elements may be omitted, or other additional elementsmay be added.

The bus 1310 may interconnect the above-described components 1131 to1370 and may be a circuit for conveying communications (e.g., a controlmessage and/or data) among the above-described components.

The processor 1320 may include one or more of a CPU, an AP, or a CP. Theprocessor 1320 may perform, for example, data processing or an operationassociated with control and/or communication of at least one othercomponent(s) of the electronic device 1301.

The memory 1330 may include a volatile and/or nonvolatile memory. Thememory 1330 may store instructions or data associated with at least oneother component(s) of the electronic device 1301. According to anembodiment, the memory 130 may store software and/or a program 1340. Theprogram 1340 may include, for example, a kernel 1341, a middleware 1343,an application programming interface (API) 1345, and/or an applicationprogram (or an application) 1347. At least a portion of the kernel 1341,the middleware 1343, or the API 1345 may be called an “operating system(OS)”.

The kernel 1341 may control or manage system resources (e.g., the bus1310, the processor 1320, the memory 1330, and the like) that are usedto execute operations or functions of other programs (e.g., themiddleware 1343, the API 1345, and the application program 1347).Furthermore, the kernel 1341 may provide an interface that allows themiddleware 1343, the API 1345, or the application program 1347 to accessdiscrete components of the electronic device 1301 so as to control ormanage system resources.

The middleware 1343 may perform a mediation role such that the API 1345or the application program 1347 communicates with the kernel 1341 toexchange data.

Furthermore, the middleware 1343 may process task requests received fromthe application program 1347 according to a priority. For example, themiddleware 1343 may assign the priority, which makes it possible to usea system resource (e.g., the bus 1310, the processor 1320, the memory1330, or the like) of the electronic device 1301, to at least one of theapplication program 1347. For example, the middleware 1343 may processthe one or more task requests according to the priority assigned to theat least one application program, which makes it possible to performscheduling or load balancing on the one or more task requests.

The API 1345 may be an interface through which the application program1347 controls a function provided by the kernel 1341 or the middleware1343. The API 1345 may include, for example, at least one interface orfunction (e.g., an instruction) for a file control, a window control, animage processing, a text control, or the like.

The I/O interface 1350 may perform an interface role to transmit aninstruction or data, input from a user or another external device, toother component(s) of the electronic device 1301. Furthermore, the I/Ointerface 1350 may output an instruction or data, received from othercomponent(s) of the electronic device 1301, to a user or anotherexternal device.

The display 1360 may display, for example, various contents (e.g., atext, an image, a video, an icon, a symbol, and the like) to a user. Thedisplay 1360 may include a touch screen and may receive, for example, atouch, gesture, proximity, or hovering input using an electronic pen ora portion of a user's body.

The communication interface 1370 may establish communication between theelectronic device 1301 and an external device (e.g., a first externalelectronic device 1302, a second external electronic device 1304, or aserver 1306). For example, the communication interface 1370 may beconnected to the network 1362 through wireless communication tocommunicate with the external device (e.g., the second externalelectronic device 1304 or the server 1306).

The wireless communication may include at least one of, for example,long-term evolution (LTE), LTE Advance (LTE-A), code division multipleaccess (CDMA), wideband CDMA (WCDMA), universal mobiletelecommunications system (UMTS), wireless broadband (WiBro), globalsystem for mobile communications (GSM), or the like, as cellularcommunication protocol. Furthermore, the wireless communication mayinclude, for example, a local area network 1364. The local area network1364 may include, for example, at least one of wireless fidelity(Wi-Fi), Bluetooth (BT), near field communication (NFC), or globalnavigation satellite system (GNSS). The GNSS may include, for example,at least one of global positioning system (GPS), global navigationsatellite system (Glonass), Beidou navigation satellite system (Beidou),or the European global satellite-based navigation system (Galileo).Hereinafter, GPS and GNSS may be interchangeably used in the followingdescriptions. The wired communication may include at least one of, forexample, a universal serial bus (USB), a high definition multimediainterface (HDMI), a recommended standard-232 (RS-232), or a plain oldtelephone service (POTS).

Each of the first and second external electronic devices 1302 and 1304may include components the same as or different from those of theelectronic device 1301. According to an embodiment, the server 1306 mayinclude one or more server groups. According to various embodiments, allor a part of operations that the electronic device 1301 will perform maybe executed by another or plural electronic devices (e.g., the first andsecond electronic devices 1302 and 1304 or the server 1306). Accordingto an embodiment, in the case where the electronic device 1301 executesany function or service automatically or in response to a request, theelectronic device 1301 may not perform the function or the serviceinternally, but, alternatively additionally, it may request at least aportion of a function associated with the electronic device 1301 atother device (e.g., the first and second electronic devices 1302 and1304 or the server 1306). The other electronic device (e.g., the firstand second electronic device 1302 and 1304 or the server 1306) mayexecute the requested function or additional function and may transmitthe execution result to the electronic device 1301. The electronicdevice 1301 may provide the requested function or service using thereceived result or may additionally process the received result toprovide the requested function or service. To this end, for example,cloud computing, distributed computing, or client-server computing maybe used.

FIG. 14 illustrates a block diagram of an electronic device according tovarious embodiments of the present disclosure.

Referring to FIG. 14, an electronic device 1401 may include, forexample, all or a part of the electronic device 1301 illustrated in theabove-mentioned various embodiments. The electronic device 1401 mayinclude one or more processors (e.g., an AP) 1410, a communicationmodule 1420, a subscriber identification module 1424, a memory 1430, asensor module 1440, an input device 1450, a display 1460, an interface1470, an audio module 1480, a camera module 1491, a power managementmodule 1495, a battery 1496, an indicator 1497, and a motor 1498.

The processor 1410 may drive an OS or an application program to controla plurality of hardware or software components connected to theprocessor 1410 and may process and compute a variety of data. Theprocessor 1410 may be implemented with a SoC, for example. According toan embodiment of the present disclosure, the processor 1410 may furtherinclude a GPU and/or an image signal processor (ISP). The processor 1410may include at least a part (e.g., a cellular module 1421) of componentsillustrated in FIG. 14. The processor 1410 may load and process aninstruction or data, which is received from at least one of othercomponents (e.g., a nonvolatile memory), and may store a variety of dataat a nonvolatile memory.

The communication module 1420 may be configured the same as or similarto the communication interface 1370 of FIG. 13. The communication module1420 may include the cellular module 1421, a wireless-fidelity (Wi-Fi)module 1423, a BT module 1425, a GNSS module 1427 (e.g., a GPS module, aGlonass module, a Beidou module, a Galileo module, etc.), a NFC module1428, and a radio frequency (RF) module 1429.

The cellular module 1421 may provide voice communication, videocommunication, a text service, an Internet service or the like through acommunication network. According to an embodiment, the cellular module1421 may perform discrimination and authentication of the electronicdevice 1401 within a communication network using the subscriberidentification module 1424 (e.g., a subscriber identification module(SIM) card), for example. According to an embodiment, the cellularmodule 1421 may perform at least a portion of functions that theprocessor 1410 provides. According to an embodiment, the cellular module1421 may include a CP.

Each of the Wi-Fi module 1423, the BT module 1425, the GNSS module 1427,and the NFC module 1428 may include a processor for processing dataexchanged through a corresponding module, for example. According to anembodiment, at least a portion (e.g., two or more components) of thecellular module 1421, the Wi-Fi module 1423, the BT module 1425, theGNSS module 1427, and the NFC module 1428 may be included within oneintegrated circuit (IC) or an IC package.

The RF module 1429 may transmit and receive a communication signal(e.g., an RF signal). The RF module 1429 may include a transceiver, apower amplifier module (PAM), a frequency filter, a low noise amplifier(LNA), an antenna, or the like. According to another embodiment, atleast one of the cellular module 1421, the Wi-Fi module 1423, the BTmodule 1425, the GNSS module 1427, or the NFC module 1428 may transmitand receive an RF signal through a separate RF module.

The subscriber identification module 1424 may include, for example, acard and/or embedded SIM including a subscriber identification moduleand may include unique identify information (e.g., integrated circuitcard identifier (ICCID)) or subscriber information (e.g., integratedmobile subscriber identity (IMSI)).

The memory 1430 (e.g., a memory 1330) may include an internal memory1432 or an external memory 1434. For example, the internal memory 1432may include at least one of a volatile memory (e.g., a dynamic randomaccess memory (DRAM), a static RAM (SRAM), or a synchronous DRAM(SDRAM)), a nonvolatile memory (e.g., a one-time programmable read onlymemory (OTPROM), a programmable ROM (PROM), an erasable and programmableROM (EPROM), an electrically erasable and programmable ROM (EEPROM)), amask ROM, a flash ROM, a flash memory (e.g., a NAND flash memory or aNOR flash memory), a hard drive, or a solid state drive (SSD).

The external memory 1434 may include a flash drive, for example, compactflash (CF), secure digital (SD), micro-SD, mini-SD, extreme digital(xD), multimedia card (MMC), a memory stick, or the like. The externalmemory 1434 may be functionally and/or physically connected to theelectronic device 1401 through various interfaces.

The sensor module 1440 may measure, for example, a physical quantity ormay detect an operation state of the electronic device 1401. The sensormodule 1440 may convert the measured or detected information to anelectric signal. The sensor module 1440 may include at least one of agesture sensor 1440A, a gyro sensor 1440B, a pressure sensor 1440C, amagnetic sensor 1440D, an acceleration sensor 1440E, a grip sensor1440F, a proximity sensor 1440G, a color sensor 1440H (e.g., red, green,blue (RGB) sensor), a biometric sensor 1440I, a temperature/humiditysensor 1440J, an illuminance sensor 1440K, or an ultra violet (UV)sensor 1440M. Although not illustrated, additionally or alternatively,the sensor module 1440 may further include, for example, an E-nosesensor, an electromyography sensor (EMG) sensor, an electroencephalogram(EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR)sensor, an iris sensor, and/or a fingerprint sensor. The sensor module1440 may further include a control circuit for controlling at least oneor more sensors included therein. According to an embodiment, theelectronic device 1401 may further include a processor which is a partof the processor 1410 or independent of the processor 1410 and isconfigured to control the sensor module 1440. The processor may controlthe sensor module 1440 while the processor 1410 remains at a sleepstate.

The input device 1450 may include, for example, a touch panel 1452, a(digital) pen sensor 1454, a key 1456, or an ultrasonic input unit 1458.The touch panel 1452 may use at least one of capacitive, resistive,infrared and ultrasonic detecting methods. Also, the touch panel 1452may further include a control circuit. The touch panel 1452 may furtherinclude a tactile layer to provide a tactile reaction to a user.

The (digital) pen sensor 1454 may be, for example, a part of a touchpanel or may include an additional sheet for recognition. The key 1456may include, for example, a physical button, an optical key, a keypad,and the like. The ultrasonic input device 1458 may detect (or sense) anultrasonic signal, which is generated from an input device, through amicrophone (e.g., a microphone 1488) and may check data corresponding tothe detected ultrasonic signal.

The display 1460 (e.g., a display 1360) may include a panel 1462, ahologram device 1464, or a projector 1466. The panel 1462 may include aconfiguration that is the same as or similar to that of the display 1360of FIG. 13. The panel 1462 may be, for example, flexible, transparent,or wearable. The panel 1462 and the touch panel 1452 may be integratedinto a single module. The hologram device 1464 may display astereoscopic image in a space using a light interference phenomenon. Theprojector 1466 may project light onto a screen so as to display animage. The screen may be arranged in the inside or the outside of theelectronic device 1401. According to an embodiment, the display 1460 mayfurther include a control circuit for controlling the panel 1462, thehologram device 1464, or the projector 1466.

The interface 1470 may include, for example, an HDMI 1472, a USB 1474,an optical interface 1476, or a D-subminiature (D-sub) 1478. Theinterface 1470 may be included, for example, in a communicationinterface 1370 illustrated in FIG. 13. Additionally, or alternatively,the interface 1470 may include, for example, a mobile high definitionlink (MHL) interface, a secure digital (SD) card/MMC interface, or aninfrared data association (IrDA) standard interface.

The audio module 1480 may convert a sound and an electric signal in dualdirections. At least a portion of the audio module 1480 may be included,for example, in an I/O interface 1350 illustrated in FIG. 13. The audiomodule 1480 may process, for example, sound information that is input oroutput through a speaker 1482, a receiver 1484, an earphone 1486, or themicrophone 1488.

The camera module 1491 for shooting a still image or a video mayinclude, for example, at least one image sensor (e.g., a front sensor ora rear sensor), a lens, an ISP, or a flash (e.g., an LED or a xenonlamp).

The power management module 1495 may manage, for example, power of theelectronic device 1401. According to an embodiment, a power managementintegrated circuit (PMIC), a charger IC, or a battery or fuel gauge maybe included in the power management module 1495. The PMIC may have awired charging method and/or a wireless charging method. The wirelesscharging method may include, for example, a magnetic resonance method, amagnetic induction method, or an electromagnetic method and may furtherinclude an additional circuit, for example, a coil loop, a resonantcircuit, or a rectifier, and the like. The battery gauge may measure,for example, a remaining capacity of the battery 1496 and a voltage,current or temperature thereof while the battery is charged. The battery1496 may include, for example, a rechargeable battery or a solarbattery.

The indicator 1497 may display a specific state of the electronic device1401 or a portion thereof (e.g., a processor 1410), such as a bootingstate, a message state, a charging state, and the like. The motor 1498may convert an electrical signal into a mechanical vibration and maygenerate effects such as vibration, haptic, and the like. Although notillustrated, a processing device (e.g., a GPU) for supporting a mobileTV may be included in the electronic device 1401. The processing devicefor supporting a mobile TV may process media data according to thestandards of DMB, digital video broadcasting (DVB), MediaFlo™, or thelike.

Each of the above-mentioned elements of the electronic device accordingto various embodiments of the present disclosure may be configured withone or more components, and the names of the elements may be changedaccording to the type of the electronic device. The electronic deviceaccording to various embodiments of the present disclosure may includeat least one of the above-mentioned elements, and some elements may beomitted or other additional elements may be added. Furthermore, some ofthe elements of the electronic device according to various embodimentsof the present disclosure may be combined with each other so as to formone entity, so that the functions of the elements may be performed inthe same manner as before the combination.

FIG. 15 illustrates a block diagram of a program module according tovarious embodiments of the present disclosure.

Referring to FIG. 15, according to an embodiment, a program module 1510(e.g., a program 1340) may include an OS to control resources associatedwith an electronic device (e.g., an electronic device 1310) and/ordiverse applications (e.g., an application program 1347) driven on theOS. The OS may be, for example, Android, iOS, Windows, Symbian, orTizen.

The program module 1510 may include a kernel 1520, a middleware 1530, anAPI 1560, and/or an application 1570. At least a part of the programmodule 1510 may be preloaded on an electronic device or may bedownloadable from an external electronic device (e.g., electronicdevices 1302 and 1304, a server 1306).

The kernel 1520 (e.g., a kernel 1341) may include, for example, a systemresource manager 1521 and/or a device driver 1523. The system resourcemanager 1521 may perform control, allocation, or retrieval of systemresources. According to an embodiment, the system resource manager 1521may include a process managing part, a memory managing part, or a filesystem managing part. The device driver 1523 may include, for example, adisplay driver, a camera driver, a BT driver, a common memory driver, anUSB driver, a keypad driver, a Wi-Fi driver, an audio driver, or aninter-process communication (IPC) driver.

The middleware 1530 may provide, for example, a function which theapplication 1570 needs in common, or may provide diverse functions tothe application 1570 through the API 1560 to allow the application 1570to efficiently use limited system resources of the electronic device.According to an embodiment, the middleware 1530 may include at least oneof a runtime library 1535, an application manager 1541, a window manager1542, a multimedia manager 1543, a resource manager 1544, a powermanager 1545, a database manager 1546, a package manager 1547, aconnectivity manager 1548, a notification manager 1549, a locationmanager 1550, a graphic manager 1551, or a security manager 1552.

The runtime library 1535 may include, for example, a library modulewhich is used by a compiler to add a new function through a programminglanguage while the application 1570 is being executed. The runtimelibrary 1535 may perform I/O management, memory management, orcapacities about arithmetic functions.

The application manager 1541 may manage, for example, a life cycle of atleast one application of the application 1570. The window manager 1542may manage a graphical user interface (GUI) resource which is used in ascreen. The multimedia manager 1543 may identify a format necessary forplaying diverse media files, and may perform encoding or decoding ofmedia files by using a codec suitable for the format. The resourcemanager 1544 may manage resources such as a storage space, memory, orsource code of at least one application of the application 1570.

The power manager 1545 may operate, for example, with a basicinput/output system (BIOS) to manage a battery or power, and may providepower information for an operation of an electronic device. The databasemanager 1546 may generate, search for, or modify database which is to beused in at least one application of the application 1570. The packagemanager 1547 may install or update an application which is distributedin the form of package file.

The connectivity manager 1548 may manage, for example, wirelessconnection such as Wi-Fi or BT. The notification manager 1549 maydisplay or notify an event such as arrival message, promise, orproximity notification in a mode that does not disturb a user. Thelocation manager 1550 may manage location information of an electronicdevice. The graphic manager 1551 may manage a graphic effect that isprovided to a user, or manage a user interface relevant thereto. Thesecurity manager 1552 may provide a general security function necessaryfor system security or user authentication. According to an embodiment,in the case where an electronic device (e.g., an electronic device 1301)includes a telephony function, the middleware 1530 may further include atelephony manager for managing a voice or video call function of theelectronic device.

The middleware 1530 may include a middleware module that combinesdiverse functions of the above-described components. The middleware 1530may provide a module specialized to each OS kind to providedifferentiated functions. Additionally, the middleware 1530 may remove apart of the preexisting components, dynamically, or may add a newcomponent thereto.

The API 1560 (e.g., an API 1345) may be, for example, a set ofprogramming functions and may be provided with a configuration which isvariable depending on an OS. For example, in the case where an OS is theandroid or the iOS, it may be permissible to provide one API set perplatform. In the case where an OS is the Tizen, it may be permissible toprovide two or more API sets per platform.

The application 1570 (e.g., an application program 1347) may include,for example, one or more applications capable of providing functions fora home 1571, a dialer 1572, an short message service (SMS)/multimediamessaging service (MMS) 1573, an instant message (IM) 1574, a browser1575, a camera 1576, an alarm 1577, a contact 1578, a voice dial 1579,an e-mail 1580, a calendar 1581, a media player 1582, an album 1583, anda timepiece 1584, or for offering health care (e.g., measuring anexercise quantity or blood sugar) or environment information (e.g.,atmospheric pressure, humidity, or temperature).

According to an embodiment, the application 1570 may include anapplication (hereinafter referred to as “information exchangingapplication” for descriptive convenience) to support informationexchange between the electronic device (e.g., an electronic device 1301)and the external electronic device (e.g., electronic devices 1302 and1304). The information exchanging application may include, for example,a notification relay application for transmitting specific informationto the external electronic device, or a device management applicationfor managing the external electronic device.

For example, the information exchanging application may include afunction of transmitting notification information, which arise fromother applications (e.g., applications for SMS/MMS, e-mail, health care,or environmental information), to an external electronic device (e.g.,electronic devices 1302 and 1304). Additionally, the informationexchanging application may receive, for example, notificationinformation from an external electronic device and provide thenotification information to a user.

The device management application may manage (e.g., install, delete, orupdate), for example, at least one function (e.g., turn-on/turn-off ofan external electronic device itself (or a part of components) oradjustment of brightness (or resolution) of a display) of the externalelectronic device (e.g., electronic devices 1302 and 1304), whichcommunicates with the electronic device, an application running in theexternal electronic device, or a service (e.g., a call service or amessage service) provided from the external electronic device.

According to an embodiment, the application 1570 may include anapplication (e.g., a health care application of mobile medical devices)which is assigned in accordance with an attribute of the externalelectronic device (e.g., electronic devices 1302 and 1304). According toan embodiment, the application 1570 may include an application which isreceived from the external electronic device (e.g., the server 1306 orthe external electronic devices 1302 and 1304). According to anembodiment, the application 1570 may include a preloaded application ora third party application which is downloadable from a server. Thecomponent titles of the program module 1510 according to the embodimentof the present disclosure may be modifiable depending on kinds of OSs.

According to various embodiments, at least a portion of the programmodule 1510 may be implemented by software, firmware, hardware, or acombination of two or more thereof. At least a portion of the programmodule 1510 may be implemented (e.g., executed), for example, by aprocessor (e.g., a processor 1410). At least a portion of the programmodule 1510 may include, for example, modules, programs, routines, setsof instructions, processes, or the like for performing one or morefunctions.

The term “module” used herein may represent, for example, a unitincluding one or more combinations of hardware, software and firmware.The term “module” may be interchangeably used with the terms “unit”,“logic”, “logical block”, “component” and “circuit”. The “module” may bea minimum unit of an integrated component or may be a part thereof. The“module” may be a minimum unit for performing one or more functions or apart thereof. The “module” may be implemented mechanically orelectronically. For example, the “module” according to variousembodiments of the present disclosure may include at least one of anapplication-specific IC (ASIC) chip, a field-programmable gate array(FPGA), and a programmable-logic device for performing some operations,which are known or will be developed.

According to various embodiments of the present disclosure, at least aportion of an apparatus (e.g., modules or functions thereof) or a method(e.g., operations) according to various embodiments of the presentdisclosure, for example, may be implemented by instructions stored in acomputer-readable storage media in the form of a programmable module.The computer-readable storage media may be, but is not limited to, thememory 1330.

A computer-readable recording media may include a hard disk, a floppydisk, a magnetic media (e.g., a magnetic tape), an optical media (e.g.,compact disc ROM (CD-ROM) and a digital versatile disc (DVD), amagneto-optical media (e.g., a floptical disk), and a hardware device(e.g., ROM, RANI, a flash memory, or the like). Also, a programinstruction may include not only a mechanical code such as thingsgenerated by a compiler but also a high-level language code executableon a computer using an interpreter. The above hardware unit may beconfigured to operate via one or more software modules for performing anoperation of the present disclosure, and vice versa.

For example, a computer-readable recording medium according to anembodiment includes instructions. The instructions, when executed by anelectronic device, cause the electronic device to perform a methodperformed by sensing a detachment of an electronic pen mounted in theelectronic device when a display of the electronic device is in anOFF-state, activating an input function of the electronic pen, obtaininga stroke input by the electronic pen, outputting a memo screen on thedisplay based on the stroke input, sensing a memo termination event, andchanging a screen output on the display in response to the memotermination event.

A module or a programming module according to an embodiment of thepresent disclosure may include at least one of the above elements, or aportion of the above elements may be omitted, or additional otherelements may be further included. Operations performed by a module, aprogramming module, or other elements according to an embodiment of thepresent disclosure may be executed sequentially, in parallel,repeatedly, or in a heuristic method. Also, a portion of operations maybe executed in different sequences, omitted, or other operations may beadded.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. An electronic device comprising: a display; apen; a slot in which the pen can be inserted or detached; a pen sensor;a pen input interface; at least one processor; and a memory storinginstructions which, when executed by the at least one processor, causethe electronic device to: while the display is in an OFF-state, sense,via the pen sensor, at least a partial detachment of the pen from theslot, in response to the at least the partial detachment of the penduring the OFF-state of the display being sensed, activate the pen inputinterface and display a memo screen with a black color background, thememo screen including at least one control menu and a pen input area forreceiving a pen stroke input via the pen input interface, sense aninsertion of the pen into the slot while the memo screen with the blackcolor background is displayed, and in response to the insertion of thepen into the slot being sensed, identify whether the electronic deviceis in a locked state and display one of a first screen or a secondscreen based on a result of the identification, the first screen beingdisplayed in response to the result of the identification being that theelectronic device is in the locked state and the second screen beingdisplayed in response to the result of the identification being that theelectronic device is not in the locked state.
 2. The electronic deviceof claim 1, wherein, in response to the insertion of the pen into theslot being sensed, the at least one processor is further configured tostore the memo screen.
 3. The electronic device of claim 2, wherein theat least one processor is further configured to: display the stored memoscreen on a memo application in response to the memo application beingexecuted.
 4. The electronic device of claim 1, wherein the first screencomprises a lock screen, and the second screen comprises a screen thatwas displayed before the display entered the OFF-state.
 5. Theelectronic device of claim 4, wherein the screen that was displayedbefore the display entered the OFF-state comprises a home screen.
 6. Theelectronic device of claim 1, wherein the first screen comprises a lockscreen.
 7. The electronic device of claim 1, wherein the second screencomprises a screen that was displayed before the display entered theOFF-state.
 8. The electronic device of claim 7, wherein the screen thatwas displayed before the display entered the OFF-state comprises a homescreen.
 9. The electronic device of claim 1, wherein, in response to theat least the partial detachment of the pen during the OFF-state of thedisplay being sensed, the at least one processor is further configuredto divide the display into a first area receiving a stroke input and asecond area including at least one control menu with respect to thestroke input, and wherein the at least one control menu comprises a savemenu with respect to a memo input to the first area.
 10. The electronicdevice of claim 9, wherein, based on the save menu being selected, theat least one processor is further configured to display a screen towhich a pre-defined setting with respect to the memo screen is applied.11. The electronic device of claim 10, wherein the pre-defined settingcomprises at least one of information on a background screen,information on a kind of pen applied to the stroke input, or informationon a color of the pen.
 12. The electronic device of claim 1, wherein theat least one processor is further configured to display the pen strokeinput in a white color over the black color background of the memoscreen.
 13. The electronic device of claim 1, wherein the display isimplemented by an active matrix organic light-emitting diode (AMOLED).14. A method of providing a memo function of an electronic device, themethod comprising: while a display of the electronic device is in anOFF-state, sensing, via a pen sensor of the electronic device, at leasta partial detachment of a pen of the electronic device from a slot ofthe electronic device; in response to the sensing of the at least thepartial detachment of the pen during the OFF-state of the display,activating a pen input interface of the electronic device and displayinga memo screen with a black color background, the memo screen includingat least one control menu and a pen input area for receiving a penstroke input via the pen input interface; sensing an insertion of thepen into the slot while the memo screen with the black color backgroundis displayed; and in response to the sensing of the insertion of the peninto the slot, identifying whether the electronic device is in a lockedstate and displaying one of a first screen or second screen based on aresult of the identifying, the first screen being displayed in responseto the result of the identifying being that the electronic device is inthe locked state and the second screen being displayed in response tothe result of the identifying being that the electronic device is not inthe locked state.
 15. The method of claim 14, further comprising: inresponse to the sensing of the insertion of the pen into the slot,storing the memo screen.
 16. The method of claim 15, further comprising:displaying the stored memo screen on a memo application in response tothe memo application being executed.
 17. The method of claim 14, whereinthe first screen comprises a lock screen, the second screen comprises ascreen that was displayed before the display entered the OFF-state. 18.The method of claim 17, wherein the screen that was displayed before thedisplay entered the OFF-state comprises a home screen.
 19. The method ofclaim 14, wherein the first screen comprises a lock screen.
 20. Themethod of claim 14, wherein the second screen comprises a screen thatwas displayed before the display entered the OFF-state.
 21. The methodof claim 20, wherein the screen that was displayed before the displayentered the OFF-state comprises a home screen.
 22. The method of claim14, further comprising: in response to the sensing of the at least thepartial detachment of the pen during the OFF-state of the display,dividing the display into a first area receiving a stroke input and asecond area including at least one control menu with respect to thestroke input, wherein the at least one control menu comprises a savemenu with respect to a memo input to the first area.
 23. The method ofclaim 22, further comprising: based on the save menu being selected,displaying a screen to which a pre-defined setting with respect to thememo screen is applied.
 24. The method of claim 23, wherein thepre-defined setting comprises at least one of information on abackground screen, information on a kind of pen applied to the strokeinput, or information on a color of the pen.
 25. The method of claim 14,further comprising: displaying the pen stroke input in a white colorover the black color background of the memo screen.
 26. A non-transitorycomputer-readable recording medium with instructions thereon, theinstructions, when executed by an electronic device, causing theelectronic device to perform: while a display of the electronic deviceis in an OFF-state, sensing, via a pen sensor of the electronic device,at least a partial detachment of a pen of the electronic device from aslot of the electronic device; in response to the at least the partialdetachment of the pen during the OFF-state of the display being sensed,activating a pen input interface of the electronic device and displayinga memo screen with a black color background, the memo screen includingat least one control menu and a pen input area for receiving a penstroke input via the pen input interface; sensing an insertion of thepen into the slot while the memo screen with the black color backgroundis displayed; and in response to the sensing of the insertion of the peninto the slot, identifying whether the electronic device is in a lockedstate and displaying one of a first screen or second screen based on aresult of the identifying, the first screen being displayed in responseto the result of the identifying being that the electronic device is inthe locked state and the second screen being displayed in response tothe result of the identifying being that the electronic device is not inthe locked state.